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Comment  on  "Generalized  Upper  Bounded 
Techniques  in  Linear  Programming" 

by 

R.  N.  Kaul 


1.  Introduction 

In  an  interestirig  paper  [l],  Dantzig  and  Van  Slyke  have  proved  a 
theorem  that  gives  an  upper  bound  on  the  number  of  sets  contsdning  at  least 
two  basic  variables.  This  fact  is  exploited  to  develop  an  algorithm  that  is 
computationally  efficient  for  a  large  scade  system  with  a  special  structure. 
It  is  possible  to  show  that  this  bound  cam  be  improved.  The  significance 
of  this  improvement  lies  in  the  fact  that  since  it  is  related  to  the  or¬ 
der  of  the  working  basis,  the  computation  can  be  carried  out  with  a  basis 
of  order  less  by  one  than  that  considered  in  [l].  The  purpose  of  this  note 
is  to  describe  it  and  Illustrate  by  an  example. 

2.  Tneorem  and  example 

The  structure  that  is  under  our  consideration  is  shown  in  Figure 
I.  It  is  assumed  to  be  of  full  rank. 

The  last  L  equations  give  a  division  of  veuriables  into  different 
sets.  The  set  denotes  the  columns  associated  with  the  variables  oc- 

curing  in  (M  +  i)^^  equation.  The  first  set  n^  +  1  columns  will  con¬ 
stitute  the  set  Sq  . 

In  [l]  the  following  theorem  is  proved: 

Theorem  1 :  At  least  one  variable  from  each  set  is  basic.  As 

suming  that  the  objective  x^  is  always  basic,  we  now  make  the  following 


-1- 


subject  to: 


statement : 


Theorem  2:  The  number  of  sets  containing  at  least  two  basic  variables  can¬ 
not  exceed  M-1  . 

Proof:  At  any  iteration  of  the  algorithm  described  in  [l]  the  basis  must 
consist  of  M+L  vectors  since  the  system  is  of  full  rank.  But 

is  always  in  the  basis  and  by  Theorem  1,  L  of  the  other  basic  vari¬ 
ables  have  to  be  in  L  different  sets.  This  leaves  only  M-1  basic 
variables  to  be  distributed  in  at  most  M-1  different  sets  and  hence 
the  theorem. 

Theorem  2  immediately  shows  that  at  any  stage  of  the  algorithm  we 
need  consider  only  M+1  sets  that  include  ,  and  all  the  sets  having  at 
least  two  basic  variables.  It  is  also  obvious  that  these  M+1  sets  must 
have  at  least  one  set  containing  exactly  one  basic  variable.  The  analysis 
of  [l]  now  goes  throtgh  and  shows  that  the  working  basis  W  must  contain 
2M  vectors. 

^  Q 

We  illustrate  this  by  means  of  the  following  example: 

Melx  Xq  subject  to: 

*0  ■  ■  ^2  *  •  ^’‘4  •  5=^5  *  ^6*°^  *  5*9  *  ^0 

^0  ■  \  +  X^  -  x^  +  x.^  +  lOxg  +  Ox^  +  5x^q 

Xg  +  x^ 

\  +  ^5 

^8  ^  ^9 


-> 


^0 


1 


Here  M  ■  2  ;  therefore,  the  working  basis  W  will  be  of  order  4. 

Suppose  the  initiail  basis  for  the  full  system  is 

0  2  4  6  7  9  10 

B  -  (A,  A,  A,  A,  A,  A,  A  ) 


and 


(A°, 


A^) 


which  consists  of  the  first  column,  basic  columns  from  the  sets  containing 
two  basic  variables  and  one  basic  column  from  the  set  having  exactly  one 
basic  variable.  Let  I  denote  the  index  set  corresponding  to  the  remaining 
inessential  columns, 


I  -  (2,  9,  10) 


Now 


,-l 


'  2/5 

1/5  1 

-1/5 

0 

0  1 

0 

1/5 

1 

TO 

1/5 

-1/5 

\ 

CVJ 

1 

2/5 

""6  ^ 

x.^)*^  -  W"^(b- 

Z  A^)  - 

T 

Since  x^  ■  1  ,  iel 

therefore  =  (8,  1,  1,  1,  0,  1,  l)"^  . 

Computing  the  price  vector,  we  find 

(7r,d)  =  (2/5,  1/3,  0,  1,  -1/5,  10/5,  -7/5)  . 
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Pricing  out  the  nonbasic  columns  yields 


Min  (7T,m.)A'^  =  (7r,M.)A^  »  --2  <  0  , 

J 


therefore  the  column  A^  qualifies  for  entry  into  the  basis. 

5 

Since  A-^eSg  which  is  essential,  therefore  we  compute 

WV  =  (-2,  1,  0,  0)*^ 


Pivoting  on  the  only  positive  component  which  replaces  the  column  A^  by 


P/  in  the  working  basis,  we  obtain  the  inverse  of  the  new  working  basis 
'^(l)  "  ^  ^ premxiltiplication  of  W  ^  with  the  matrix 

/  1  2  0  0  \ 

I  0  1  0  0  1 


0  0 


0  0  1 


Thus 


2/5 

1/5 

5 

-1/5 

0 

0 

1 

0 

1/5 

-1/5 

2 

1/5 

-1/5 

1/5 

-2 

2/5 

The  index  I  remains  unchanged,  hence 


\a) 


(10,  1,  1,  0)- 


J 


and 


\il) 


(10,  1,  1,  1,  0,  1,  l)*^ 


The  full  pricing  vector  is 


(7r,n)  -  (2/5,  1/5,  0,  5,  -1/3,  10/5,  -7/3)  . 

Since  Min(7r,ii)A'^  =■  (7r,|i)A^  =*  -5/3  <  0  ,  therefore  A^  becomes  eligible 
for  entry  in  the  basis.  But  A^cSq  which  is  essential,  hence  we  compute 

A?-  =  W^^jA^  .  (-5/3,  0,  -1/5,  1/3)'^  . 

When  we  pivot  on  the  last  component  of  A^  ,  we  introduce  A^  in  the  working 

7 

basis  replacing  A'  . 

Thus  the  new  working  basis  and  its  inverse  are  given  by 

“(2)  = 
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Where  premultiplication  of  W/^  »  with  the  matrix 


(1) 

10  0  5 

0  10  0 


\ 


0  0  11 
0  0  0 


yields  W 


-1 

(2)  • 


Ordering  the  columns  in  ^^2)  '  obtain 


A 

W 


(g)  .  (A°,  A^,  t?,  A®) 


and 


/- 


\ 


V 


12-75 
-11-6  2 
0  0  10 

0  0  °  ^  / 


obtained  from  premultiplication  of  by  appropriate  permutation  matrix. 

We  note  again  that  index  set  I  is  unchanged.  Ilierefore 


\(2) 


(10,  1,  0,  1) 


\(2)  = 


The  new  price  vector  is 


(7T,n)  -  (-1,  2,  -5,  -7,  5,  -5,  -4) 
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and 


Min(7r,u)A’^  =  (7T,|i)A^  <  0  . 

J 

Hence  A^  is  introduced  in  the  basis.  Since  A  eS^  which  is  inessential, 
therefore  we  compute 

W’^(A^  -  A^)  =  (-8,  -6,  0,  0)'^ 

The  absence  of  any  positive  component  shows  that  where  decreases  to 

zero,  goes  to  upper  bound  without  blocking.  In  this  case,  the  index 

/  \  ^-1 

set  changes  to  =  (3,  9,  10)  and  ^(^2)  uneiltered.  Hence 

V  (5)  ”  "(2) 

and 

Xb^(3)  -  1)"  • 

Now  the  price  vector  is 

(7r,u)  -  (-1,  2,  3,  -7,  3,  -5,  -h) 
and  for  all  columns 

(7r,tL)A'^  ^  0  , 

hence  we  have  the  optimal  solution  given  by 
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X 


0 


-  18 


-  1 


6 


-  1 


Xg  -  0  ,  x^  »  0 

Xj  .  1  ,  Xg  .  0 

•*4  ”  °  .  *9  “  1 

^0  ■ 


3.  Conclusion 

In  the  example  of  [l]  starting  with  the  working  basis  of  order  4 
we  obtain  the  following  cycles. 


Cycle  0 


W  .  {A°,  A^, 

a5) 

la  (4 

/l/2 

1/2 

-1/2 

-5/2\ 

w-1  . 

1  -1/ii 

1/4 

5/4 

1/4 

1/4 

-1/4 

1/4 

-1/4 

1  0 

0 

0 

1  / 

Xy  -  (5,  1/2,  1/2,  1)^  ,  X  -  (3,  1/2,  1/2,  1,  1,  if 
1  ^ 


Pricing  vector:  (l/2,  1/2,  -1/2,  -5/2,  -5/2,  -9/2,  2) 


enters  and  leaves  the  basis. 
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Cycle  1 


“(1)  ■  “ 


W(1^  w 


I  “  6,  7) 


Xy  -  (6,  0,  1,  1)“^  ,  X_  =  (6,  0,  1,  1,  1,  1, 


Pricing  vector:  (l/2,  1/2,  -1/2,  -5/2,  -5/2,  -5/2,  2) 


g 

A  enters  and  becomes  essential. 


A'  becomes  essential  in  place  of 


which  is  made  inessential. 


A  leaves  the  basis. 


Cycle  2 


'(2) 


'(2) 


A^  A^, 

a8) 

I  =  (3, 

4,  6) 

A/ 20 

11/20 

-7/20 

42/20 

0 

0 

1 

0 

1/20 

-1/20 

-5/20 

8/20 

\-l/20 

1/20 

5/20 

2/20 

/ 


x^  =  (6,  1,  1,  0) 

i 


(6,  1,  1,  1,  1,  1,  0)- 


Pricing  vector:  (9/20,  11/20,  -7/20,  -49/20,  -47/20,  -51/20,  42/20) 
All  columns  price  out  optimally.  Hence  the  optimal  solution: 


L  =  (6,  1,  1,  1,  1,  1,  0)  , 

1 


=  0 
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